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NOTEPAD 

Field of the Invention 

The present invention relates to a product having at 
least one writing surface which is provided with a posi- 
tion code, which codes a plurality of positions on the 
5 writing surface to enable electronic recording of infor- 
mation which is being written on the writing surface, by- 
means of a device which detects the position code. Fur- 
thermore, the invention relates to a device, a system, 
a computer program and a method for information manage- 

10 ment . The invention also relates to a handheld electronic 
device which i*fe adapted to carry out predetermined opera- 
tions at the command of a user. 
Background of the Invention 

Many people use pen and paper instead of a computer 

15 to write short texts, particularly notes of telephone 
conversations and meetings. The reason may be that no 
computer is available, that both hands are needed to 
efficiently enter text by way of a computer keyboard, 
or that it takes a long time to start the right program 

20 in the computer. Even if the notes are written on a sheet 
of paper, people often wish to input certain parts of 
them to a computer, for example a note about a meeting 
into a digital calendar or an address into a digital 
address book. 

25 US 5,852,434 and US 5,477,012 disclose a device 

enabling a user to input handwritten and hand-drawn 
information to a computer while the information is being 
written/drawn on the writing surface. The device com- 
prises a writing surface, on which are arranged a posi- 

30 tion code cording X-Y coordinates and a special pen with 
a writing point for writing or drawing on the writing 
surface. Moreover, the pen has a light source for illumi- 
nating the position code and a CCD sensor for receiving 
the light reflected by the position code. The position 
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information received by the CCD sensor is sent to a com- 
puter for processing. This device appears to require a 
computer to be started and a certain program to be opened 
before the writing on the writing surface can begin. 
5 Similar devices are disclosed in US 5,661,506, 

US 5,051,736, US 5,652,412 and US 5,442,147. 

US 5,932,863 discloses how a user can access an 
electronic medium by reading, using a device, a symbol, 
code or the like in a piece of printed matter, for 

10 instance a book. The device sends a signal with the read 
symbol to a control unit which executes a command corre- 
sponding to the symbol . 
Summary of the Invention 

An object of the present invention is to further 

15 simplify the management of handwritten information which 
is recorded electronically. 

This object is wholly or partly achieved by a 
product according to claim 1, a device according to 
claim 20, a computer program according to claim 39, a 

20 system according to claim 43, and a method according to 
claim 45 . 

More specifically, according to a first aspect, the 
invention relates to a product having at least one writ- 
ing surface which is provided with a position code, which 

25 codes a plurality of positions on the writing surface to 
enable electronic recording of information which is being 
written on the writing surface, by means of a device 
which detects the position code. Furthermore, the product 
has at least one activation icon which, when detected by 

30 the. device, causes the device to initiate a predetermined 
operation which utilises the information recorded by the 
device. 

Thus, in addition to a writing surface, the product 
also has an activation icon by means of which the user 
35 can command the device to process the recorded informa- 
tion in a predetermined manner. As a result, it is not 
necessary for the user to press keys or buttons on the 
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device itself or on an associated computer to which the 
information is transferred. Instead she uses the activa- 
tion icon on the product as a means for commanding the 
device to process the information in. the desired manner. 
5 In this way, the user can write information and control 
the processing thereof in a uniform manner. Moreover, the 
user can, immediately as the information is being created 
on the writing surface, define how the information is to 
be processed. The information need not be transferred to 

10 a computer and the user need not give the computer spe- 
cial commands for processing the information, which makes 
it possible for the user to work much in the same way as 
he does with paper and pen and still utilise all the 
facilities of electronics. 

15 The activation icon can be likened to an icon on 

a computer screen, but instead of placing the screen 
cursor on the icon and clicking with the aid of a mouse, 
the user enters the command by placing the device so that 
it can detect the activation icon on the product. The 

20 product thus constitutes a new type of user interface 
for managing information which is written on a writing 
surface . 

The written information which is recorded is in this 
case all information that can be produced by hand, such 

25 as text, numbers, different types of written characters, 
figures and drawings. It can also be referred to as gra- 
phical input. 

The activation icon can be in the form, of an image, 
a symbol, text, numbers or the like, enabling a user to 

30 understand and remember which operation is initiated when 
she uses the icon. The detection of the icon by means of 
the device can be based on the above characteristics 
which the user utilises to interpret the meaning of the 
icon, or on other characteristics, such as some kind of 

3 5 symbol or code which the device detects, such as a bar 
code . 
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The activation icon can be detected before or after 
recording of the information that is to be used in the 
operation corresponding to the activation icon. According 
to a first alternative, first information is recorded, 
5 then the activation icon is read and after that the ope- 
ration corresponding to the activation icon is initiated. 
According to a second alternative, first the activation 
icon is read, after that the information is recorded and 
then the operation corresponding to the activation icon 
10 is initiated. 

The writing of information on the writing surface 
can, but need not, result in traces being left on the 
writing surface. If traces are left, they can be left 
permanently or temporarily, for instance when using ink 
15 which fades away after some time. 

Ink or a iolorant need not be used to write on the 
surface. The "writing" can also be provided by etching, 
burning, projecting or some other operation which leaves 
traces on the writing surface. 

2 0 The device which detects the position code and the 

activation icon can be one and the same device which 
utilise one and the same sensor for detection. Alter- 
natively, it can utilise two different sensors or con- 
sist of two physically separate units, of which one 

25 detects the position code and the other the activation 

icon. The alternative of the position code and the acti- 
vation icon being detectable by one and the same device 
is, of course, preferred owing to the user friendliness. 
In a preferred embodiment, also the activation icon 

30 is provided with the position code that is located on 
the writing surface. As a result, the information and 
the activation icon can be recorded according to the 
same principle, which simplifies the construction of the 
device and simplifies the use of the device for the user. 

3 5 The position code can be designed so as to extend 

continuously over the writing surface and said at least 
one activation icon in such manner that the activation 
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icon is detectable by means of the position code as a 
predetermined position on the product. 

All positions of the writing surface and the activa- 
tion icon. are thus coded, with a position code which indi- 
5 cates its absolute position in relation, to one and the 
same origin which can be found on the product or outside 
the product . This position code is easy to apply but has 
its limitation by the location of the activation icon 
having to be determined in advance and not being movable 
10 since the device which detects the activation icon does 
so on the basis of its location on the product. 

In a preferred embodiment, the position code on the 
writing surface is therefore discontinuous with the posi- 
tion code of said at least one activation icon. In this 
15 embodiment, like in the "continuous" embodiment, the 
position or positions which is/are coded by the posi- 
tion code on the activation icon is/are predetermined 
' to represent the activation icon, but in contrast to the 
"continuous" embodiment, the position/positions is/are 
20 unrelated to the actual location of the activation icon 
on the product . 

In a preferred embodiment, the position code with 
which the activation icon is provided constitutes a first 
subset of an absolute position code which codes coordi- 
2 5 nates for points on a imaginary surface, the first subset 
coding coordinates for at least one point on the imagi- 
nary surface, which point is dedicated to initiation of 
said operation. 

The position code can advantageously code coordi- 
30 nates for a large number of points or positions, much 

larger than the number of required positions on the pro- 
duct with the writing surface. The coordinates for all 
the points coded by the position code can jointly be said 
to constitute an imaginary surface. This property of the 
35 position code of being able to code a very large number 
of points can be used to increase the functionality of 
the position code. More specifically, one or more points 
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on the imaginary surface can be dedicated to initiation 
of a specific operation. This point always represents 
the same thing independently of on which product and 
where on this product it is used. This construct ion faci- 
5 litates the design of a new system with many different 
products having a writing surface and at least one acti- 
vation icon. 

Another part of the imaginary surface can corre- 
spondingly be dedicated to be used as a writing surface. 
10 In a preferred embodiment, the position code with which 
said writing surface is provided therefore constitutes 
a second subset of an absolute position code which codes 
coordinates for points on an imaginary surface, the 
second subset ifcoding coordinates within an area on the 
15 imaginary surface, said area being dedicated to electro- 
nic recording of information. 

The operation corresponding to said at least one 
activation icon may comprise transfer of the recorded, 
information to another unit. In this context, the user 
2 0 may have to indicate an address which defines where the 
information is to be sent. For instance, the address can 
be fetched from a register in the device, from a computer 
or from the writing surface. 

In a preferred embodiment, however, the product has 
2 5 a character recognition area which is provided with the 
position code. Information which is written in this area 
will be subjected to character recognition. In the first 
place, it is intended for address information. A piece of 
address information can be an IP address, a fax number, a 
30 phone number, an e-mail address or some other information 
defining a receiver which can be reached via a machine. 
It can also be used to write keywords that are stored 
together with the information recorded from the writing 
surface, thus making this searchable later by means of 
35 the keywords, or to write a title in, for instance, an 
e-mail . 
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In a preferred embodiment, the position code with 
which said character recognition area is provided is a 
third subset of an absolute position code coding coor- 
dinates for points on an imaginary surface, the third 
5 subset coding coordinates within an area on the imaginary- 
surface, which area is dedicated to information that is 
to be subjected to character recognition. 

The writing surface, the activation icon and the 
character recognition area are thus coded by different 
10 subsets of the absolute position code. These subsets can 
be continuous with each other or discontinuous with each 
other. 

As already mentioned, the product has at least one 
activation icon. In a preferred embodiment, however, the 

15 product has a plurality of activation icons for activat- 
ing various predetermined operations. The user can thus 
choose between different operations which use the record- 
ed information. 

The position code, and the activation icon in case 

20 it is not detected by means of a position code, can be 

designed in various ways. For instance, they can be elec- 
trically, chemically or mechanically detectable. They 
need not be detectable using the same principle. In a 
preferred embodiment, however, both the icon and the 

25 position code are optically detectable. Thus, they will 

be more easy to apply to a product since they can be, for 
instance, printed thereon. Moreover a device with one or 
more optical sensors can be used for the detection of the 
icon and the position code. In this embodiment, the acti- 

30 vation icons and the position code are passive. They need 
only have an effect on light so that the sensor receives 
light with different intensity on the one hand from the 
background and, on the other hand, from the activation 
icons and/or the position code. The effect can occur, for 

35 instance, by reflection, absorption, emission, fluores- 
cence, or transmission. However, the light need not be in 
the visible range. 
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The activation icon can activate the device to ini- 
tiate essentially any conceivable operation whatever 
which uses the recorded information. In fact the selec- 
tion is only limited, by the functions of the device which 
5 is to use the product. There can be a standard set of 

activation icons on the product. It is not necessary for 
all devices to be able to use all activation icons. 

In an advantageous embodiment, the predetermined 
operation is an operation from the group: dialling a 

10 telephone number included in the recorded information, 

sending a fax containing the recorded information, send- 
ing an electronic message containing the recorded infor- 
mation, entering address information included in the 
recorded information in an electronic address book, 

15 entering calendar information included in the recorded 
information in an electronic calendar, entering a task 
included in the recorded information in an electronic 
list, printing the recorded information on a printer, and 
storing the recorded information at a predetermined loca- 

20 tion. 

There can be different types of the position code. 
It can be of a type which codes each position with a 
unique symbol. The position code can, however, preferably 
be of a type which codes each position with a plurality 

25 of symbols, each symbol contributing to the coding of 
more than one position. Examples of how this type of 
overlapping or floating code can be implemented and 
detected are to be found in, inter alia, Applicant's pre- 
vious Applications No. SE 9901954-9 which was filed on 

30 28 May 1999 and SE 9903541-2 which was filed on 1 October 
1999. These applications are incorporated herewith by 
reference. An example of the position code according to 
the latter application will be given below. The advantage 
of the position code of this type is that it provides 

35 good resolution and is easy to detect since the indivi- 
dual symbols can be made uncomplicated. 
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In a preferred embodiment, the position code com- 
prises a raster and a plurality of symbols, the value of 
each symbol being determined by the location of a marking 
in relation. to said raster. This position code is parti- 
5 cularly simple and reliable to detect and image process 
since it merely requires identification of a marking 
which can be identical for all the symbols. 

The product can be any type of product having a 
writing surface and at least one activation icon. It may 

10 consist of two physically separate parts, the writing 

surface with the position code being located on one part 
and the activation code on the other. Alternatively, it 
may consist of a single part incorporating both the acti- 
vation icon and the writing surface. The activation icon 

15 can then be positioned on the writing surface or on some 
other surf ace. ^The product can be, for example, a sheet 
of paper with a writing surface with a position code on 
one part of the paper and an activation icon on another 
part. In a preferred embodiment, the product is a notepad 

20 with a plurality of writing surfaces. 

The different sheets of the notepad can be identi- 
cal, in which case the position code thus codes the same 
positions on all the sheets. In an alternative embodi- 
ment, however, the position code codes different posi- 

25 tions on the different sheets so that an identification 
of the sheets can be made on the basis of the positions 
coded by the position code. 

Alternatively, the product can be a paper product 
consisting of at least one sheet comprising said writing 

30 surface, at least part of a surface of the sheet being 
coated with a preferably weakly adhesive layer. 

Such a product can be used in the same way as the 
products sold under the trademark Post -It, but with the 
advantage that what is written on the product can simul- 

35 taneously be recorded electronically. 

Moreover, according to a second aspect, the inven- 
tion relates to a device for information management, 
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which is adapted to electronically record information 
which is being written on a writing surface. The device 
is further adapted to initiate a predetermined operation 
which uses the electronically recorded information when . 
5 it detects a predetermined activation icon. 

An advantage of this device is that is easy to use 
since the user need not learn different commands and need 
not press different buttons to open a desired program. 
As mentioned above, the device will at least ini- 

10 tiate, however possibly with a certain delay, the prede- 
termined operation when the icon is detected. Depending 
on which functions are available in the device, it can 
in some cases carry out the entire operation. In other 
cases, the device can, for instance, automatically trans- 

15 fer the recorded information and information about which 
operation is to be carried out to an external unit, such 
as a PC or mobile telephone, which finishes the opera- 
tion. This transfer can occur immediately or on a later 
occasion. By "initiate" is here meant that the device 

20 ensures that the operation is carried out even if it 

does not carry out the operation itself, so that the user 
need not give an additional command to the device or the 
external unit for the operation to be carried out. How- 
ever, the user may need to supply additional information 

25 and/or confirm the operation/information. In its simplest 
embodiment, the device need not itself recognise or 
interpret the coordinates corresponding to the different 
activation icons, but it ensures that a desired operation 
will be carried out by passing on all coordinates to a 

3 0 unit which can interpret them. 

The device need not be used together with the above 
product with a position code on the writing surface, but 
it can record the information that is being written on 
the writing surface in alternative manners. It may com- 

3 5 prise, for example, an accelerometer which records the 
movement of the device when the device is used to write 
on a writing surface. It can alternatively comprise a 



WO 01/16691 - PCT/SE00/01667 

11 

scanner which scans the information. In a preferred 
embodiment, however, the device is, as has been stated 
above, adapted to record the information by detecting a 
position code that is located on the writing surface. 
5' This embodiment is advantageous since the information is 
recorded while being written on the surface. The user can 
thus have both a paper version and an electronic version 
of what has been written. The position code is recorded 
continuously as the information is being written, a 
10 sequence of position indications being obtained, which 

define how the device has been moved. The device is also 
advantageous since it enables the use of the same tech- 
nique for recording of information and for detection of 
the activations icon. 
15 As stated above, the activation icon can be designed 

in various ways, and therefore different types of sensors 
can be used in the device depending on the technique with 
which the activation icon is implemented. In a preferred 
embodiment, the device is, as stated above, adapted to 
20 detect the activation icon by means of a position code 
with which the activation icon is provided. 

It is per se possible to implement the device with 
two sensors of the same or of a different type, but the 
device will be less expensive and easier to use if it is 
2 5 implemented with a single sensor for both recording of 
information and detection of the activation icon, pre- 
ferably in the form of a position code. 

The sensor is advantageously an optical sensor 
which is adapted to record images of the writing surface. 
30 The optical sensor is advantageous since it allows the 
recording of information and the initiation of the pre- 
determined operation to be based on image processing 
which is a well-known and well -developed technique. 

In a preferred embodiment, the device further com- 
35 prises a signal processor which is adapted to detect, in 
a signal from said at least one sensor, the activation 
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icon and the recorded information for initiation of the 
predetermined operation. 

The signal processor can be implemented, for exam- 
ple, with a microprocessor with suitable associated cir- 
5 cuits and software or as an ASIC (Application Specific 
Integrated Circuit) , or as an FPGA (Field Programmable 
Gate Array) or similar programmable circuits. In the 
input signal which it receives, it need be able to iden- 
tify what constitutes the activation icon and what con- 
10 stitutes the recorded information that the operation 
corresponding the activation icon is to use. 

If the activation icon and the recorded information 
are detected with two different sensors, for example with 
an optical sensor and an accelerometer , respectively, 
15 this is easy since the signal processor then receives 
signals from two different sources. 

As mentioned above, however, both the information 
and the activation icon are advantageously recorded by 
means of a position code. In a preferred embodiment, the 

2 0 signal processor is then adapted to receive the position 

code recorded by said at least one sensor, to determine 
which position the recorded position code codes, to 
determine, on the basis thereof, whether the position 
code relates to the writing surface, in which case the 

25 position is processed as representing information that 

has been written on the writing surface, or to the acti- 
vation icon, in which case the predetermined operation 
corresponding to the position is initiated. 

Although the signal processor receives the same type 

30 of signal from the sensor, it can thus identify that 

represented by the position code and take suitable mea- 
sures. To be able to carry out the identification, the 
signal processor must know which positions represent the 
writing surface and which represent the activation icon. 

3 5 The positions which identify the respective areas can 

be stored in a memory in the device or at some other 
location where they are available for the device, for 
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instance at a predetermined location in a computer net- 
work to which the position code is sent. 

The signal processor can advantageously comprise 
a character recognition function for converting the 
5 recorded information to a character-coded format. The 
advantage of this is that the device can interpret the 
information and process it in an intelligent manner on 
the basis of the contents. As long as the information 
is merely represented as positions, it can, however, 

10 only be processed as graphical information. 

The character recognition function can be used to 
interpret information that is written in a specific char- 
acter recognition area or is written in an arbitrary 
position on the writing surface, but which the user then 

15 marks for character recognition, e.g. by underlining the 
information. In the former case, only the information in 
the specific area will be interpreted whereas all other . 
written information is processed as graphical informa- 
tion. 

2 0 In a preferred embodiment, the device further com- 

prises a memory for storage of the recorded information. 
This means that the device can be used in a stand-alone 
mode quite independently of other units. The user can 
record information and indicate which operation is to be 

25 carried out, whereupon the device carries out the opera- 
tion when there is a possibility, for example when it 
gets into contact with an external unit, and then fetches 
recorded information from the memory. The device thus 
need not initiate the operation immediately as the acti- 

30 vat ion icon is detected. 

It is desirable that it should be possible to carry 
out a plurality of different operations for different 
notes that are written on different occasions on diffe- 
rent parts of one and the same writing surface. This 

3 5 means that the device must know which part of the record- 

ed information is to be used when a predetermined opera- 
tion is to be executed. 
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In order to solve this problem, the device is in one 
embodiment adapted to use, when initiating the predeter- 
mined operation, that part of the information which has 
been recorded from the writing surface during a predeter- 
5 mined period. The period can be an absolute period or a 
relative period, for instance the period after the imme- 
diately preceding detection of an activation icon. In 
practical terms, this can be solved by the memory where 
the recorded information is stored being erased after 

10 each initiated operation. Alternatively, the period can 
be after the detection of the activation icon so that 
all information that is recorded during a predetermined 
period after the detection of the activation icon is used 
in the operation initiated via the activation icon. 

15 As an alternative, the device can be adapted to use, 

when carrying $ut the predetermined operation, informa- 
tion that has been recorded in an area on the writing 
surface. The area can be predetermined so that informa- 
tion recorded from this area always is used when carrying 

20 out the operation. Alternatively, the user himself can 
each time define the area in question, for example by 
reading the coordinates from the corners of a rectangular 
area within which the information is to be used. It goes 
without saying that this alternative can also be combined 

25 with a time limit. An advantage of sending information 
from a certain area is that information can be sent a 
plurality of times and that previously recorded informa- 
tion can be supplemented. 

For the device not to be too complicated and thus 

3 0 expensive to manufacture, the device can advantageously 
use functions of external units for initiation and exe- 
cution of certain operations. To this end, the device 
comprises in a preferred embodiment a transceiver for 
wireless short-range communication. The transceiver is 

35 advantageously a radio transceiver utilising the so- 
called Bluetooth technology. It can alternatively be 
some other transceiver which can communicate wirelessly 
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at a distance of less than about 100 m, e.g. an IR tran- 
sceiver, an ultrasonic transceiver, a transceiver using 
ordinary light or a radio transceiver operating according 
to the Air-port technology. 
5 The entire device can advantageously be arranged 

in one casing, but in an alternative embodiment it is 
also conceivable that the sensor or sensors, i.e. the 
part used by the user to record the information and the 
activation icon, can be located in a first casing while 

10 the signal processor, i.e. the part initiating the pre- 
determined operation on the basis of the detected acti- 
vation icon, can be located in a second casing. 

The communication between the first and the second 
casing can take place wirelessly or via cable. The second 

15 casing can be e.g. a personal computer, the signal pro- 
cessor being software which is installed in the personal 
computer. It is also conceivable that some processing of 
e.g. the recorded position code occurs in the first cas- 
ing before the transfer to the second casing occurs. 

2 0 In a more advanced and, thus, technically more com- 

plicated and more expensive design, the device comprises 
a mobile telephone transceiver for transferring the 
recorded information from the device to an external unit, 
the predetermined operation being an operation from the 

25 group dialling a telephone number included in the record- 
ed information, sending a fax containing the recorded 
information, sending an electronic message containing . the 
recorded information, printing the recorded information 
by means of a printer, and storing the recorded informa- 

30 tion in the external unit. 

According to a third aspect of the present inven- 
tion, it relates to a computer program for information 
management, which is stored on a memory medium which can 
be read by a computer and which comprises instructions 

35 to cause the computer to detect an activation icon in an 
image and, in response to the detection of the activation 
icon, initiate a predetermined operation. The advantages 



WO 01/16691 - PCT/SEOO/01667 

of this program are evident from the discussions above. 
The computer can be the processor that is included in the 
device described above. 

According to a fourth aspect of the present inven- 
5 tion, it relates to a. system for information management, 
comprising a device which is adapted to record informa- 
tion electronically, and a product which is provided with 
at least one activation icon which indicates a predeter- 
mined operation, the device being adapted to initiate the 
10 predetermined operation for the recorded information in 
response to the detection of the activation icon. 

The advantages of the system are evident from the 
discussion above. 

According^ to a fifth aspect of the invention, it 

15 relates to a method of managing information, comprising 
the steps of writing information on a writing surface 
with a device; recording the written information electro- 
nically with the device; and causing the device to ini- 
tiate a predetermined operation for the recorded inf or- 

20 mation by letting the device detect an activation icon 

before or after the recording of the written information. 

This method makes it possible for the user to manage 
information in a very simple manner. She can write down 
the information as usual with a device comprising a pen 

25 on a sheet of paper, but still directly initiate one or 

more operations which normally require starting of a spe- 
cial computer program and subsequent input of the infor- 
mation into a computer, merely by letting the device 
detect an activation icon. It is not necessary according 

3 0 to the invention that the information be written before 
the activation icon is detected. It is also conceivable 
to let the device detect the activation icon before the 
note is made. The writing step and the recording step 
can, as stated above, advantageously be carried out 

3 5 simultaneously. 

The technique described above could also be used 
for general control of handheld computers and other hand- 
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held electronic devices, such as mobile telephones, PDAs, 
reading pens and handheld scanners. Such devices are nor- 
mally controlled by the user, by means of one or more 
buttons, making a selection on menus or among icons that 
5 are shown on the display of the computer. These devices . 
could be controlled more easily by using activation icons 
which activate different predetermined operations which 
are normally executed by the pressing of buttons. 

To that end, the invention relates, according to 

10 one more aspect, to a handheld electronic device which 
is adapted to carry out predetermined operations at the 
command of a user. This device has a sensor for detect- 
ing at least one activation icon, and a signal processor 
which is adapted to carry out, in response to the sen- 

15 sor's detection of the activation icon, one of said pre- 
determined operations. 

The device can especially be a reading pen sold 
under the trademark OPEN. Such a reading pen is describ- 
ed in, for instance, SE 9604008-4. This device is con- 

20 trolled by means of buttons and menus shown on a dis- 
play. The control could be simplified by using activa- 
tion icons. 

The activation icon or icons can be positioned, for 
instance, on a product of the type mouse pad, on a sheet 

25 of paper or on some other product which is easily avail- 
able to the user. The predetermined operation can be any 
operation whatever which a user normally commands a hand- 
held electronic device to execute by means of a mouse, 
buttons or keys of a keyboard. Examples of such opera - 

3 0 tions are starting or closing a program, and saving or 
deleting information that has been recorded. 

What has been said above about the device for infor- 
mation management and the product with activation icons 
is, of course, applicable in appropriate parts also as 

35 regards control of a handheld electronic device. 
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Brief Description of the Drawings 

The present invention will now be described in more 
detail by way of embodiments with reference to the accom- 
panying drawings in which 
5 Fig. 1 is a schematic view of an embodiment of a 

product according to the invention in the form of a note- 
pad sheet; 

Fig. 2 is a schematic view of an enlarged part of 
the sheet in Fig . 1 , 
10 Fig. 3 shows schematically how symbols included in 

the position-coding pattern can be composed, 

Fig. 4 is a schematic view of an example of 4 x 4 • 
symbols that are used to code a position, 

Fig. 5 shows schematically how the position-coding 

p. 

15 pattern is arranged on the notepad sheet according to 
Fig. 1 and on the imaginary surface, respectively, 

Fig. 6 is a schematic view of an embodiment of 
a device according" to the invention, 

Fig. 7 shows schematically how a device according 
2 0 to the invention can communicate with external units, 
Figs 8a and 8b show a paper product according to 
a second embodiment of a product according to the inven- 
tion, and 

Fig. 9a shows the function of a computer program 
2 5 stored on a storage medium according to the invention, 
and 

Fig. 9b is a block diagram which illustrates the 
steps corresponding to instructions of such a program. 
Detailed Description of a Preferred Embodiment 
30 Below follows a description of the currently most 

preferred embodiment of the invention in the form of a 
notepad sheet and a device for use together with the 
notepad sheet. Subsequently, alternative embodiments will 
be described. 
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. THE PRODUCT 

Writing Surface 

Fig. 1 shows a product in the form of a notepad 
sheet 1 of paper. The sheet 1 has a writing surface 3, 
5 a command field 4 and an address area A. 

On the writing surface 3 there is printed a posi- 
tion code 5 which is composed of symbols. Each symbol 
comprises a marking in the form of a dot 6. The loca- 
tion of the dot 6 in relation to an imaginary raster 
10 extending over the writing surface determines the value 

of the symbol. For the sake of clarity, the position code 
is shown schematically on only a small part of the writ- 
ing surface, and this part of the position code has been 
enlarged. 

15 The position code 5 will be described in more detail 

below under the title Position Code. 

The position code on the writing surface 3 makes it 
possible to electronically record graphical, information, 
such as handwritten text and numbers and hand-drawn 

2 0 figures, while being produced on the writing surface 3. 
More specifically, the position of a pen point which 
produces the graphical information is recorded conti- 
nuously by reading the position code locally at the pen 
point. In this manner, a digital representation of the 

2 5 movement of the pen point over the writing surface is 
provided. 

Activation Icons . 

In the command field 4, there are printed seven dif- 
ferent activation icons 7a-g which can be used to command 

30 a device to initiate and/or execute different operations. 
The icons 7a-g comprise on the one hand an activation 
area 8 which is the area within which a user can position 
a device to record the icon and in this manner initiate 
the predetermined operation and, on the other hand, a 

35 visual indication 9 of the function of the icon which is 
graphically designed in such manner that the user under- 
stands which operation is activated by the icon. The 
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visual indications 9 are in this example images, but they 
may also comprise text and/or numbers and/or other sym- 
bols. They are placed in the activation areas 8, but they 
can also be placed outside, but in connection with these, 
5 if they are not used to detect the icon. 

In the shown embodiment, the activation icons are 
provided with the same position code as the writing sur- 
face, but the position code codes one or more positions 
other than those coded by the position code on the writ- 

10 ing surface. The position code is schematically shown on 
only a small part of one of the activation icons and this 
part has been enlarged. 

Each icon corresponds to a predetermined operation 
which is to be initiated when the icon is "activated", 

15 i.e. detected by an appropriate device. The icons in this 
embodiment are examples only. A person skilled in the art 
can design a large number of other icons with associated 
predetermined operations. 
1.3 Character Recognition Area 

20 At the bottom of the sheet there is a character 

recognition area A. This is in the first place intended 
for address information which is required in connection 
with different operations which are initiated by the 
activation icons and which need be subjected to character 

25 recognition, but it can also be used for keywords and 
other text that need be subjected to character recog- 
nition. The character recognition area A is visually 
separated from the writing surface so that its extent 
is clear to the user. In this embodiment, the area is 

30 also divided into sections B which each are intended to 
receive one character. The character recognition area is 
provided with the same position code as the writing sur- 
face and the activation icons, but the position code in 
the address area codes other positions than the position 

35 code on the writing surface and the activation icons. The 
position code is shown schematically on only a small part 
of the area A. This part has been enlarged. 



WO 01/16691 r PCT/SE00/01667 

21 

1.3 Position Code - In general terms 

The position code can be of different types. A pos- 
sible type of position code where each position is coded 
with a unique symbol is disclosed in US 5,852,434 men- 
5 tibned by way of introduction. 

In the preferred embodiment of the present inven- 
tion, each position is, however, advantageously coded by 
means of a plurality of symbols, and the coding is such 
that each symbol in the position code contributes to the 
10 coding of more than one position. This means that two 
neighbouring positions have partly common symbols. In 
this manner, a higher resolution is achieved and the 
detection will be easier since the individual symbols 
can be less cdmplex. This type of overlapping or float - 
15 ing position code can be provided by means of a computer. 
A special way of generating such a floating position 
code is described in Applicant's previous Swedish Patent 
Application No. 9901954-9 that was filed on 28 May 1999 
and is incorporated herein by reference. 
20 Now follows a description of an alternative type of 

floating position code which is the presently most pre- 
ferred position code. This position code is the subject 
matter of Applicant's Swedish Patent Application No. 
9903541-2 that was filed on 1 October 1999. It is below 
25 referred to as a position-coding pattern since a surface 
to which the position code is applied gives a slightly 
patterned impression. 

Fig. 2 shows an enlarged part of the sheet in Fig. 1 
which on its surface 2 is provided with the position- 
30 coding pattern 5. The sheet has an x coordinate axis and 
a y coordinate axis. 

The position-coding pattern comprises a virtual 
raster which neither is visible to the human eye nor can 
be detected directly by a device which is to determine 
35 positions on the surface, and a plurality of symbols 
which each can assume one of four values "1" - "4" as 
will be described below. 
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The position-coding pattern is arranged in such a 
manner that the symbols on a partial surface of the sheet 
of paper code absolute coordinates of a point on an ima- 
ginary surface, which will be described below. A first 
5 and a second partial surface 25a, 25b are indicated by 
dashed lines in Fig. 2. That part of the position-coding 
pattern (in this case 4x4 symbols) which is to be found 
on the first partial surface 25a codes the coordinate's of 
a first point, and that part of the position-coding pat- 
10 tern which is to be found on the second partial surface 
25b codes the coordinates of a second point on the ima- 
ginary surface. Thus the position-coding pattern is par- 
tially shared by the adjoining first and second points. 
Such a position-coding pattern is in this application 

15 referred to as "floating". 

Figs 3a-3b show an embodiment of a symbol which can 
be used in the position-coding pattern. The symbol com- 
prises, a virtual raster point 30 which is represented by 
the intersection between the raster lines, and a marking 

20 6 which has the form of a dot. The value of the symbol 
depends on where the marking is located. In the Example 
in Fig. 3, there are four possible locations, one on 
each of the raster lines extending from the raster 
points. The displacement from the raster point is equal 

25 to all values. In the following, the symbol in Fig. 3a 
has the value 1, in Fig. 3b the value 2, in Fig. 3c the 
value 3 and in Fig. 3d the value 4. Expressed in other 
words, there are four different types of symbols. 

It should be pointed out that the dots can, of 

30 course, have a different shape. 

Each symbol can thus represent four values "1-4". 
This means that the position-coding pattern can be divid- 
ed into a first position code for the x coordinate, and 
a second position code for the y coordinate. The division 

35 is effected as follows: 
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Symbol value 


x-code 


y-code 


1 


1 


1 


2 


0 


1 


3 


1 


0 


4 


0 


0 



Thus, the value of each symbol is translated into 
a first digit, in this case bit, for the x-code and a 
5 second digit, in this case bit, for the y-code. In this 
manner, two completely independent bit patterns are 
obtained. The patterns can be combined to a joint pat- 
tern, which is coded graphically by means of a plurality 
of symbols according to Fig. 3. 
10 The coordinates for each point is coded by means of 

a plurality of symbols. In this example, use is made of 
4x4 symbols to code a position in two dimensions, i.e. 
an x-coordinate and a y-coordinate . 

The position code is made up by means of a number 
15 series of ones and zeros which have the characteristic 
that no sequence of four bits appears more than once in 
the series. The number series is cyclic, which means that 
the characteristic also applies when one connects the end 
of the series to the beginning of the series . Thus a 
20 four-bit sequence always has an unambiguously determined 
position in the number series. 

The series can maximally be 1,6 bits long if it is to 
have the above -described characteristic for sequences of. 
four bits. In this example, use is, however, made of a 
25 series having a length of seven bits only as follows: 

"0001010". 
This series contains seven unique sequences of four 
bits which code a position in the series as follows: 
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Position in the series 


Sequence 


0 


0001 


1 


0010 


2 


0101 


3 


1010 


4 


0100 


5 


1000 


6 


0000 



For coding the x- coordinate, the number series is 
written sequentially in columns across the entire surface 
5 that is to be dfcded. The coding is based on the 

difference or position displacement between numbers in 
adjoining columns. The size of the difference is deter- 
mined by the position (i.e. with which sequence) in the 
number series, in which one lets the column begin. More 

10 specifically, if one takes the difference modulo seven 
between on the one hand a number which is coded by a 
four-bit sequence in a first column and which thus can 
have the value (position) 0-6, and, on the other hand, 
the corresponding number (i.e. the sequence on the same 

15 "level") in an adjoining column, the result will be the 
same independently of where along the two columns one 
makes the comparison. By means of the difference between 
two columns, it is thus possible to code an x-coordinate 
which is constant for all y-coordinates . 

20 Since each position on the surface is coded with 

4x4 symbols in this example, three differences (having 
the value 0-6) as stated above are available to code the 
x-coordinate. Then the coding is carried out in such man- 
ner that of the three differences, one will always have 

25 the value 1 or 2 and the other two will have values in 
the range 3-6. Consequently no differences are allowed 
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to be zero in the x-code. In other words, the x-code is 
structured so that the differences will be as follows: 
(3-6) (3-6) (1-2) (3-6) (3-6) (1-2) (3-6) (3-6) (1-2)... 
Each x-coordinate thus is coded with two numbers between. 
5 3 and 6 and a subsequent number which is 1 or 2. If three 
is subtracted from the high numbers and one from the low, 
a number in mixed base will be obtained, which directly 
yields a position in the x-direction, from which the 
x-coordinate can then be determined directly, as shown 
10 in the example below. 

By means of the above described principle, it is 
thus possible to code x-coordinates 0,1,2..., with the ■ 
aid of numbers representing three differences. These dif- 
ferences are coded with a bit pattern which is based on 
15 the number series above. The bit pattern can finally be 
coded graphically by means of the symbols in Fig. 3. 

In many cases, when reading 4x4 symbols, it will not 
be possible to produce a complete number which codes the 
x-coordinate, but parts of two numbers. Since the least 
20 significant part of the numbers is always 1 or 2 , a com- 
plete number, however, can easily be reconstructed. 

The y-coordinates are coded according to the same 
principle as used for the x-coordinates. The cyclic . 
number series is repeatedly written in horizontal rows 
25 across the surface which is to be position-coded. Just 
like in the case of the x-coordinates, the rows are 
allowed to begin in different positions, i.e. with dif- 
ferent sequences,, in the number series. However, for 
y-coordinates one does not use differences but codes 
30 the coordinates with numbers that are based on the start- 
ing position of the number series on each row. When the 
x-coordinate for 4x4 symbols has been determined, it is 
in fact possible to determine the starting positions in 
the number series for the rows that are included in the 
35 y-code in the 4x4 symbols. In the y-code the most sig- 
nificant digit is determined by letting this be the only 
one that has a value in a specific range. In this exam- 
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pie, one lets one row of four begin in the position 0-1 
in the number series to indicate that this row relates 
to the least significant digit in a y-coordinate, and the 
other three begin in the position 2-6. In y-direction, 
5 there is thus a series of numbers as' follows: 

(2-6) (2-6) (2-6) (0-1) (2-6) (2-6) (2-6) (0-1) (2-6)... 
Each y-coordinate thus is coded with three numbers 
between 2 and 6 and a subsequent number between 0 and 1 . 
If 0 is subtracted from the low number and 2 from 
10 the high, one obtains in the same manner as for the 
x-direction a position in the y-direction in mixed 
base from which it is possible to directly determine 
the y-coordinate. 

With the ^bove method it is possible to code 
15 4 x 4 x 2 = 32 positions in x-direction. Each such 

position corresponds to three differences, which gives 
3 x 32 = 96 positions. Moreover, it is possible to code 
5x5x5x2= 250 positions in y-direction. Each such 
position corresponds to 4 rows, which gives 4 x 250 = 
20 1000 positions. Altogether it is thus possible to code 
96000 positions. Since the x-coding is based on diffe- 
rences, it is, however, possible to select in which posi- 
tion the first number series begins. If one takes into 
consideration that this first number series can begin 
25 in seven different positions, it is possible to code 

7 x 96000 = 672000 positions. The starting position of 
the first number series in the first column can be cal- 
culated when the x-coordinate has been determined. The 
above-mentioned seven different starting positions for 
30 the first series may code different sheets of paper or 
writing surfaces on a product. 

With a view to further illustrating the function 
of the position-coding pattern, here follows a specific 
example which is based on the described embodiment of 
35 the position code. 

Fig. 4 shows an example of an image with 4x4 symbols 
which are read by a device for position determination. 
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These 4x4 symbols have the following values: 
4 4 4 2 

3 2 3 4 

4 4 2 4. 
5 1 3 2 4 

These values represent the following binary x- and 
y-code : 

x-code : y-code : 

0000 0001 
10 1010 0100 

0000 0010 
1100 1010 
The vertical x-sequences code the following 
positions in the number series: 2 0 4 6. The diffe- 
15 rences between the columns will be -2 4 2, which modulo 
7 gives: 5 4 2, which in mixed base codes position 
(5-3) x 8 + (4-3) x 2 + (2-1) = 16 + 2 + 1 « 19. Since 
the first coded x-position is position 0, the. difference 
which is in the range 1-2 and which is to be seen in the 
20 4x4 symbols is the twentieth such difference. Since fur- 
thermore there are a total of three columns for each such 
difference and there is a starting column, the vertical 
sequence furthest to the right in the 4x4 x-code belongs 
to the 61st column in the x-code (3 x 20 + 1 = 61) and 
25 the one furthest to the left belongs to the 58th. 

The horizontal y- sequences code the positions 
0 4 1 3 in the number series. Since these series begin 
in the 58th column, the starting position of the rows are 
these numbers minus 57 modulo7, which yields the starting 
30 positions 6 3 0 2. Translated into digits in the mixed 

base, this will be 6-2, 3-2, 0-0, 2-2 =4100 where the 
third digit is the least significant digit in the number 
at issue. The fourth digit is then the most significant 
digit in the next number. In this case, it must be the 
35 same as in the number at issue. (An exceptional case is 

when the number at issue consists of the highest possible 
digits in all positions. Then one knows that the begin- 



WO 01/16691 PCT/SE00/01667 

28 

ning of the next number is one greater than the beginning 
of the number at issue.) 

The position of the four-digit number will then in 
the mixed base be 0x50 +. 4x10 + 1x2 + 0x1 = 42 . 
5 The third row in the y-code thus is the 43rd which 

has the starting position 0 or 1, and since there are 
four rows in all on each such row, the third row is num- 
ber 43x4=172. 

Thus, in this example, the position of the uppermost 
10 left corner for the 4x4 symbol group is (58,170). 

Since the x- sequences in the 4x4 group begin on row 
170, the x-columns of the entire pattern begin in the ■ 
positions of the number series ((2046) - 169) modulo 
7=1635. Between the last starting position (5) and 
15 the first starting position, the numbers 0-19 are coded 
in the mixed base, and by adding up the representations 
of the numbers 0-19 in the mixed base, one obtains the 
total difference between these columns. A naive algorithm 
to do so is to generate these twenty numbers and directly 

2 0 add up their digits. The resulting sum is called s. The 

sheet of paper or writing surface will then be given by 
(5-s) modulo7 . 

In the example above, an embodiment has been 
described, in which each position is coded with 4x4 
25 symbols and a number series with 7 bits is used. Of 

course, this is but an example. Positions can be coded 
with a larger or smaller number of symbols. The number 
of symbols need not be the same in both directions. The 
number series can be of different length and need not 

3 0 be binary, but may be based on another base. Different 

number series can be used for coding in x-direction and 
coding in y-direction. The symbols can have different 
numbers of values. As is evident from the above, a coding 
with 6x6 symbols is presently preferred, each symbol 
35 being capable of assuming four values. A person skilled 
in the art can readily generalise the above examples to 
concern such coding. 
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In the example above, the marking is a dot but may, 
of course, have a different appearance. For example, it 
may consist of a dash or some other indication which 
begins in the virtual raster point and extends therefrom 
5 to a predetermined position. As one more alternative, the 
marking may consist of a rectangle , a square, a triangle 
or some other convenient, easily detected figure. The 
marking can be filled or open. 

In the example above, the symbols within a square 
10 partial surface are used for coding a position. The par- 
tial surface may have a different form, such as hexago- 
nal. The symbols need not be arranged in rows and columns 
at an angle of 90° to each other but can also be arranged 
at other angles, e.g. 60°, and/or in other arrangements. 
15 They could also code positions in polar coordinates or 
coordinates iriMother coordinate systems. 

For the position code to be detected, the virtual 
raster must be determined. This can be carried out by 
studying the distance between different markings. The 
2 0 shortest distance between two markings must derive from 
two neighbouring symbols having the value 1 and 3 (hori- 
zontally) or 2 and 4 (vertically) so that the markings 
are located on the same raster line between two raster 
points. When such a pair of markings has been detected, 

2 5 the associated raster points can be determined with know- 

ledge of the distance between the raster points and the 
displacement of the markings from the raster points. When 
two raster points have once been iocated, additional 
raster points can be determined by means of measured dis- 

3 0 tances to other markings and with knowledge of the rela- 

tive distance of the raster points. 

The position-coding pattern described above can code 
a large number of unique positions and more specifically 
the absolute coordinates of these positions. All the 
35 positions or points that can be coded by means of the 
position-coding pattern can be said to jointly make up 
an imaginary surface. Different parts of the imaginary 
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surface can be dedicated to different specific purposes. 
One area of the imaginary surface can, for instance, be 
dedicated to be used as a writing surface, another as 
a character recognition area and yet other areas as 
5 various activation icons. Other areas of the imaginary 
surface can be used in other applications. A correspond- 
ing subset of the position-coding pattern can then be 
used to create, for example, a certain activation icon 
which can be arranged in an optional location on a pro- 

10 duct. The coordinates coded by this subset of the posi- 
tion-coding pattern thus do not relate to a position on 
the product but to a position on the imaginary surface, 
which position is dedicated always to correspond to this 
activation icon. 

15 In the presently preferred embodiment, the nominal 

interspace between the dots is 0.3 mm. Any part whatever 
of the position-coding pattern which contains 6x6 dots 
defines the absolute coordinates of a point on the ima- 
ginary surface. Each point .on the imaginary surface is 

20 thus defined by a 1 . 8 mm x 1.8 mm subset of the position- 
coding pattern. By determining the position of the 6x6 
dots on a sensor in a device which is used to read the 
pattern, a position can be calculated by interpolation on 
the imaginary surface with a resolution of 0.03 mm. Since 

2 5 each point is coded with 6x6 dots which can each assume 

one of four values, 2 72 points can be coded, which with 
the above-mentioned nominal interspace between the dots 
corresponds to a surface of 4.6 million km 2 . 

The absolute position- coding pattern can be printed 

3 0 on any paper whatever or other material which enables a 

resolution of about 600 dpi. The paper can have any size 
and shape whatever depending on the intended application. 
The pattern can be printed by standard offset printing. 
Ordinary black carbon-based ink or some other ink which 
3 5 absorbs IR light can advantageously be used. This means 

in fact that other inks, including black ink which is not 
carbon-based, can be used to superimpose other printed 
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text on the absolute position-coding pattern, without 
interfering with the reading thereof. 

A surface which is provided with the above-mention- 
ed pattern printed with carbon-based black ink will be 
5 experienced by the human eye as only a slight grey shad- : 
ing of the surface (1-3% density) , which is user-friendly 
and aesthetically pleasing. 

Of course, a smaller or large number of dots than 
described above can be used to define a point on the ima- 
10 ginary surface and a larger or smaller distance between 
the dots can be used in the pattern. The examples above 
are only given to demonstrate a presently preferred 
implementation of the pattern. 
Position Code on the Product 
15 Figs 5a shows the sheet 1 in Fig. 1 once more, the 

different subsets of the position-coding pattern being 
marked with different kinds of hatching. The sheet com- 
prises nine different areas which correspond to the writ- 
ing surface 3, the address area A and the seven activa- 
20 tion icons 7a-g. Each of these areas is provided with a 
separate subset of the position-coding pattern. Fig. 5b 
shows corresponding coordinate areas on the imaginary 
surface I, the areas being given the same reference nume- 
rals with the " sign added. The imaginary surface con- 
25 sists of the coordinate area (0,0; x n/ 0; x n ;y ra ; 0,y m ) . It 
is evident that the position code is not continuous over 
the entire product but that the different subsets are 
fetched from different parts of the imaginary surface. 
The different coordinate areas on the imaginary surface 
3 0 are dedicated to the respective purposes. This means that 
a completely new layout of the sheet can be created with- 
out requiring any modifications in the device which is to 
record information from the writing surface 3, interpret 
address information from the address area A and detect 
35 the various activation icons 7a-g and initiate the cor- 
responding operations. 
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An activation icon can be provided by means of the 
coordinates for a single point on the imaginary surface. 
In order to simplify detectability , a corresponding sub- 
set of the position-coding pattern can be repeated seve- 
5 ral times over the activation area of the activation 

icon. The repetition of the subset, however, must occur 
with a certain blank so that the subset which codes the 
coordinates for the point can be detected unambiguously. 
Alternatively, the entire sheet 1 could be provided 

10 with a position-coding pattern which codes coordinates 
for a continuous coordinate area on the imaginary sur- 
face. In this case, each activation icon consists of a 
predetermined subset of the position-coding pattern which 
is coherent with the subset of the position-coding pat- 

15 tern which is located on the writing surface. The acti- 
vation icon is detected when the pen has first been 
raised from the writing surface and then the coordinates 
of one or more points which are dedicated to the acti- 
vation icon are recorded. The requirement that the pen be 

20 raised before the detection of the activation icon has 

the advantage that it is possible to distinguish between 
the user unintentionally writing over the activation icon 
and the user intentionally placing the pen on the activa- 
tion icon to initiate the predetermined operation. 

25 As mentioned above, the product can be provided with 

a plurality of activation icons to initiate different 
operations. In an alternative embodiment, the product has 
only one activation icon which defines that an operation 
is to be carried out. The user then defines himself which 

30 operation is to be initiated by writing in the activation 
area of the activation icon a symbol, a character, a word 
or some other predetermined indication which indicates 
which operation is to be initiated. The contents of the 
activation icon can be interpreted either in the device 

3 5 which detects the icon or in an external unit to which 

the information recorded from the writing surface and the 
activation area is transmitted. 
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The activation icons are in the first place used to 
initiate an operation. They could also be used to qualify 
the recorded information, e.g. characteristics thereof, 
such as colour of the pen, line thickness and the like. 
5 THE DEVICE 

Fig. 6 shows a device which can be used to electro- 
nically record graphical information which is produced 
on the writing surface and to initiate and/or carry out 
operations which are triggered by the detection of the 
10 activation icons. 

The device comprises a casing 11 having approxi- 
mately the shape of a pen. In one short side of the cas- 
ing there is an opening 12 . The short side is intended to 
abut against or be placed a small distance from the writ- 
15 ing surface 3,^ the address area A and the activation 
icons 7a-7g. 

The casing contains essentially an optics part, and 
electronic circuitry part and a power supply. The optics 
part comprises at least one IR light -emitting diode 13 
2 0 for illuminating the surface which is to imaged and a 
light-sensitive area sensor 14, such as a CCD or CMOS 
sensor, for recording a two-dimensional image. The device 
may also comprise a lens system (not shown) . 

The power supply to the device is obtained from a 

2 5 battery 15 which is mounted in a separate compartment 

in the casing. 

The electronic circuitry part comprises a signal 
processor 16. The signal processor 16 is accomplished 
by means of a suitably programmed microprocessor, it con- 

3 0 tains software to analyse images from the sensor to pro- 

duce a digital representation of the graphical informa- 
tion which is provided on the writing surface arid to 
detect the activation icons. It also comprises software 
to initiate and/or carry out the operations determined by 
35 the activation icons. It may also comprise user software, 
such as address book program to allow the user to keep 
track of address information, calendar program to allow 
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the user to keep track of calendar information, such as 
meetings, birthdays, and other information entered in a 
calendar or diary, as well as to-do- list program so that 
the user can enter tasks which she is to carry out . 
5 Advantageously, the signal processor 16 also com- 

prises ICR software which can' be used for interpreting 
recorded characters so that they can be stored, managed 
and/or transferred in character-coded format. 

The signal processor also comprises a memory 17 for 
10 storing information which is recorded from the writing 
surface 3 and the address area A. 

On the casing of the device there is also a pen 
point 18, with the aid of which it is possible to write 
ordinary pigment -based writing on the writing surface. 
15 The pen point 18 is extendable and retractable so that 

the user can control whether or not it is to be used. The 
pen point is displaced in relation to the sensor 14. The 
sensor thus does not detect the exact position of the 
pen point. If desired, this, may however, be calculated, 
2 0 knowing the position of the pen point in relation to the 
sensor. 

Moreover, the device comprises buttons 19 by means 
of which the device can be activated and controlled for 
operations which are not controlled by the activation 
2 5 icons. 

The device also comprises a transceiver 20 for wire- 
less communication, via short-range radio link according 
to the Bluetooth technology, of information over short 
distances. This wireless transmission can be used when 

30 the device cannot itself carry out the entire initiated 
operation but needs to forward the recorded information 
and information about which operation is to be carried 
out to an external unit. 

Finally, the device may also comprise a display 21 

35 for showing, for instance, recorded information. The dis- 
play is not necessary. Showing can, if at all necessary, 
be carried out on a display of an external unit. 
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Applicant's Swedish Patent No. 9604008-4 describes 
a device for recording text. If programmed in a suitable 
way, this device can be utilised to record information 
which is being written in a writing surface provided with 
5 a position code, to detect activation icons, and to ini- 
tiate/carry out operations activated by the activation 
icon. 

In an alternative embodiment, the electronic cir- 
cuitry part may comprise or be integrated with a mobile 
10 telephone unit which comprises a mobile telephone tran- 
sceiver, which makes it possible to telephone, send 
faxes, and send e-mail messages to an external unit in 
the form of a telephone, a fax machine or a computer. 

Furthermore, the device may have an indicating means 
15 22, such as a light -emitting diode or a buzzer or a 
vibrator which indicates when the device detects the 
position code, so that the user knows that the written 
information is. actually recorded electronically. 
THE FUNCTION 

20 The function of the notepad sheet in Fig. 1 and the 

device in Fig. 6 will be described below. 

A user uses the device in Fig. 6 to write or draw 
information on the writing surface 3. While the user 
writes, the optical sensor 14 continuously captures 

25 images of the writing surface 3 in the current position 
of the pen. The images contain the position code 5. The 
signal processor 16 locates the position code, i.e. the 
dots 6, in each image and * determines on the basis thereof 
the coordinates for the position coded by the position 

30 code. In the signal processor, it is programmed how posi- 
tion information from different coordinate areas is to be 
processed. The signal processor can thus identify posi- 
tion indications from the coordinate area corresponding 
to the writing surface 3 as representing recorded infor- 

35 mation from the writing surface 3. This results in a 

description, in the form of a large number of position 
indications, of how the pen is moved over the sheet. This 
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description constitutes a digital representation of the 
written information. 

It should be pointed out that it is not necessary 
for the device to leave any trace on the writing surface 
5 since the electronic recording is based, on imaging of the 
position code, not on what is actually written on the 
writing surface. 

The digital representation of what has been written 
on the writing surface is stored in the memory 17. 
10 If the user now wants to carry out a certain opera- 

tion as regards the recorded information, she initiates 
the information by placing the device on the correspond- 
ing activation icon 7. The user can possibly make a mark- 
ing, for instance put a mark over the icon for the device 
15 to detect a plurality of positions corresponding to the 
activation icon. In principle, however, it is sufficient 
for a single position in the activation area 8 to be 
recorded. The signal processor 16 processes images 
recorded from the activation area 8 of the activation 
20 icon in the same way as the images of the writing sur- 
face. It identifies the position code, decodes the coor- 
dinate, determines to which coordinate area the coordi- 
nates belong and, accordingly, how the coordinates, i.e. 
the position indication, are to be processed. When the 
25 signal processor detects that the position indication 

originates from an activation icon, it initiates the cor- 
responding operation. The signal processor may suitably 
give the user some kind of feedback, such as a sound sig- 
nal, which indicates to the user that the activation icon 
30 has actually been detected. 

If the operation requires address information, the 
user writes this in the character recognition area A. 
Images which are then recorded by the optical sensor 14 
are processed by the signal processor in the same way as 
3 5 described above. When the signal processor identifies 

that information is involved, which is to be subjected to 
character recognition, the information is, however, input 



WO 01/16691 



PCT/SE00/01667 



to the character recognition program to be converted to 
character-coded format so that the signal processor can 
interpret the contents of the information. 

Alternatively, the character recognition can be car- 
5 ried out in an external unit to which the recorded infor- 
mation is sent in graphical format. 

When the signal processor has identified which ope- 
ration is to be carried out, it collects the recorded 
information which is to be used in the operation from the 
10 memory 17. It may, for instance, fetch all information 
stored in the memory, or a subset thereof, for instance 
all information that has been stored during a predeter- 
mined period before the activation of the activation 
icon, or all information from a certain coordinate area, 
15 for instance the coordinate area corresponding to the 
writing surface 3 on the sheet. 

Certain operations can be carried out in their 
entirety by the device itself,, such as storage of a note 
in the pen, or entering a piece of information in a user 

2 0 program in the device. These operations can always be 

carried out by the device in stand-alone mode. 

Other operations may require communication with the 
outside world. These operations can be begun in stand- 
alone mode but cannot be completed until the device is 
25 connected to the outside world. The signal processor 16 
can then communicate directly with a neighbouring exter- 
nal unit via the Bluetooth transceiver 20, such as a fax 
machine, a printer or the like, which is also provided 
with a Bluetooth transceiver, to make this carry out the 

3 0 desired operation while using the recorded information 

from the writing surface 3 and the address information 
from the character recognition area A. 

Alternatively, the processor 16 can, as shown in the 
example in Fig. 7, communicate via the Bluetooth tran- 
35 sceiver 20 with a mobile telephone 30 which works as a 
modem for the device, for further transmission of the 
information recorded from the writing surface 3 to, for 
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instance, a computer 31, another mobile telephone 32 or 
a fax machine 33, whose address is indicated in the char- 
acter recognition area A. 

As a further alternative, the device can transmit 
5 the recorded information and the address information 
together with information about which operation is to 
be carried out to a neighbouring computer which, for 
instance, arranges the information as an e-mail and 
sends it to the indicated address. 
10 As yet another example, the device may comprise or 

be integrated with a mobile telephone transceiver so that 
it can carry out the operations which require direct com- 
munication. 

As will be appreciated by a person skilled in the 
15 art, the processing of the images of the position code 

can be distributed in various ways among on the one hand 
the signal processor 16 in the device and, on the other 
hand, hardware and/or software in an external unit with 
which the device communicates. Such hardware and/or soft- 
20 ware which is adapted to carry out some of the tasks of 
the signal processor 16 is therefore considered to be 
part of the signal processor although it is not physi- 
cally integrated therewith. 

In the extreme case, the pen- shaped casing comprises 

2 5 according to Fig, 6 essentially only the optics part, the 

power supply, and the transceiver 20 which transmits the 
recorded images to another unit in a second casing which 
contains a suitably programmed processor which carries 
out the above-described processing of the images of the 

3 0 position code. 

Now follow some concrete Examples of the use of the 
notepad sheet 1 . 
Example 1 

Now assume in this Example that the device in Fig. 6 
35 is integrated with a mobile telephone. The device can be, 
for example, releasably attached to the mobile telephone. 
Also assume that a user receives a telephone call on the 
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mobile telephone. She writes notes on the notepad 1 by 
means of the pen point 18 of the device. Assume, for 
example, that the person who calls wants the user to call 
Jack at a certain telephone number. The user then writes 
5 "Call Jack 9857299" on the notepad 1, as shown in Fig. 1. 

When the user has finished her telephone conversa- 
tion she places the device on the uppermost icon which 
looks like a telephone. When the device detects the tele- 
phone icon, it starts a program for dialling a telephone 

10 number with the aid of the mobile telephone. If all 

information written on the writing surface 3 is subjected 
to character recognition, the dialling program can fetch 
the figures of the telephone number directly from the 
recorded information. Alternatively, the user can write 

15 the figures in the character recognition area A, whereby 
they are automatically subjected to character recogni- 
tion. The program shows the figures on the display 21 and 
waits for the user to confirm by pressing a button that 
the number is correct and that it should actually be 

20 dialled. After the confirmation, the number is dialled 
automatically and the user can speak to Jack. 

Another example of how the notepad and the device 
can be used is as follows. The user remembers she is 
supposed to pick up her car at 4 p.m. at the garage. She 

25 writes a note on her notepad "pick up car at 4 p.m.", see 
Fig. 1, by means of the pen point 18 of the device. This 
information is recorded in the device by means of the 
position code. The user then places the pen on the calen- 
dar program icon 7e, whereupon the pen detects it and 

3 0 activates the calendar program. The program fetches the 

recorded information. Naturally, if the information is in 
the form of position indications it can only be stored as 
position indications in the calendar program. In this 
case, the program can suggest that the note be entered 

35 under today's date and ask the user to confirm this by 

pressing a button on the pen. However, if the information 
is in character-coded format, the program can interpret 
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time and set an alarm. 

The other activation icons can be used in a similar 

way. 

5 The fax icon 7b can be used if the user wishes to 

send a fax. In this case, the user writes her fax mes- 
sage on the writing surface 3 and the fax address in 
the address area A and activates the fax program by 
means of the icon 7b. The fax program in the device 

10 then composes the fax automatically and sends it to 

the intended receiver, for example by using the mobile 
telephone 30 in Fig. 7 as a modem. 

E-mail messages can be composed and sent correspond- 
ingly by activating the e-mail icon 7c. As an alternative 

15 to e-mail, SMS messages can be sent. In both cases, the 
contents of the message can either be converted to char- 
acter-coded format or be sent in graphical format. 
Address information which need be subjected to character 
recognition to be able to be used by the device can be 

20 written in the character recognition area A. The title or 
subject of the e-mail message can also be written in the 
character recognition area so that it can be stated in 
the "title" of the message. 

Information for an address book or a to-do-list can 

2 5 be managed in the same way as the information for the 

calendar program with the aid of the address book icon 
7d and the to-do-list icon 7f . 

As examples of further usable activation icons, men- 
tion can be made of a printer icon, which when detected 

3 0 makes the device initiate a print -out of the recorded 

information on a printer, and a storage icon which causes 
the device to store the recorded information in. a pre- 
determined location or in a location indicated by the 
user in the address area A, for instance in a notebook 
35 in the user's personal computer with which the device 

communicates. To this end, the device can have a storage 
program. Finally, certain notes can be removed from the 



WO 01/16691 PCT/SE00/01667 

41 

memory of the pen with the aid of the recycle bin icon 
7g. 

The notepad sheet 1 shown in Fig. 1 can constitute 
part of a notepad with a plurality of sheets. In one 
5 embodiment, all sheets are identical. In another embodi- 
ment, at least the position code on the writing surface 
is different on the different sheets so that it is pos- 
sible to distinguish notes made on different sheets from 
each other. One and the same activation icon can also be 

10 coded in different ways on different sheets to make it 
possible to identify to which sheet the activation icon 
belongs. As one more alternative, the user can herself, 
in a suitable manner indicate on which sheet or in which 
area an operation is to be carried out, for instance by 

15 indicating a sheet number in an intended area adjacent 
to the activation icon. 

The activation icons can be arranged on a part which 
is physically separated from the writing surface so that 
the activation icons can be used, for example, for a plu- 

2 0 rality of notepads. 
Example 2 

Figs 8a and 8b show paper products according to the 
invention. Fig. 8a shows a sheet 80, where part 81 of the 
surface of the rear of the sheet is coated with a weakly 

25 adhesive layer. The adhesion of the layer is sufficiently 
strong for the sheet 80 to be fixed to a plane vertical 
surface without coming loose by its own weight. Adhesion 
should simultaneously be sufficiently weak for the sheet 
80 to be easily removed from the surface. Such adhesive 

30 materials are well known and used in so-called note 

blocks which are sold, for example, under the trademark 
POST- IT. The front of the sheet constitutes a writing 
surface 82. This is coated with a position-coding pattern 
83 of the same type as described above. A plurality of 

35 activation icons 84, 85, 86 are printed on the writing 
surface with a function as the one described above. The 
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activation icons can preferably be designed as boxes to 
be marked. 

Preferably, a paper product, like the one described 
in connection with Fig. 8a, is manufactured and sold in. 
5 blocks as shown in Fig. 8b. There a large number of 

essentially identical sheets of the type described above 
are joined in the form of a block by means of the weakly 
adhesive layers which are applied to the rear of each 
sheet. Preferably, however, the lowermost sheet of each 

10 block is free from adhesive material. The paper product 
can be used similarly to the notepad sheet described 
above (Fig. 1) . 

Fig. 9a shows the function of a computer program, 
stored on a storage medium, according to the invention. 

15 This computer program preferably functions in connection 
with the paper product described above. In such cases, a 
computer program is provided for a computer system 90, 
which program is adapted to detect both graphical inputs 

91 carried out on a writing surface 92, coated with a 
20 position code, and activation icons 93 positioned on or 

in connection with this writing surface 92. A graphical 
input is essentially the same as a digital representation 
of handwritten information. 

The use of the computer program proceeds as follows: 
25 a user writes a graphical input 91 on the writing surface 

92 by means of a pen point of a reading pen 94 of the 
type which is described with reference to Fig. 6 and 
which is capable of detecting the position code of the 
writing surface 92. The graphical input 91 is transmitted 

30 simultaneously in digital form, preferably as a polygon 
train representing the positions detected by the reading 
pen 94 when the graphical input 91 is being written on 
the writing surface 92, to the computer system 90 with 
the aid of e.g. a short-range radio link. Subsequently 

35 the user marks a certain activation icon 95 with a cross 
to indicate that the graphical input is to be associated 
with a certain application in the computer system 90. 
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Also the position-coding pattern where the selected acti- 
vation icon is positioned can be detected by the reading 
pen 94, and therefore also information corresponding to 
these positions is transmitted to the computer system 90. 
5 The computer system 90 can therefore determine which 
activation icon the user has chosen and consequently 
which application the user wants to associate with the 
graphical input 91. The computer system 90 is adapted 
then to reproduce the graphical input 91' in a window 96 

10 belonging to the current application or associated there- 
with, for instance the neighbouring one. The computer 
system 90 can also be integrated in the reading pen 94. 

The user may herself configure the computer program 
in a number of ways. For instance, the user can by set- 

15 tings in the program link a certain activation icon or 
box on a base to a certain application in a computer 
system. The user can also allow more operations than the 
reproduction to be carried out. For instance, a message 
can be sent to another user while at the same time being 

2 0 shown in a window in an application in the computer sys- 
tem. It is also possible to link an activation icon to a 
plurality of applications in a computer system or to 
applications in several computer systems. The program 
can be varied and used in several ways similarly to that 

25 described above. 

Fig. 9b is a block diagram illustrating steps corre- 
sponding to instructions of such a program. In a first 
step 98, the computer system detects a certain activation 
icon of a product. In a second step 99, a graphical input 

30 is detected. The mutual sequence of the first and the 
second step is determined by the order in which a user 
makes a choice of activation icon and the carrying out 
of a graphical input. In a third step 100, the computer 
system reproduces the graphical input detected in the 

35 second step 99 in a program window associated with or 

belonging to an application associated with the activa- 
tion icon recorded in the first step 98. 
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According to one more variant, the device in Fig. 6 
can be controlled by means of activation icons which can 
be designed like those on the notepad sheet in Fig. 1, 
but concern operations of the type open and close pro- 
5 .grams and other operations which the user normally com- 
mands via the buttons 19 on the device. The function 
is exactly the same as described above except that no 
recorded information need be used to carry out the ope- 
rations . 
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CLAIMS 

1. A product having at least one writing surface (3) 
5 which is provided with a position code (5) , which codes 

a plurality of positions on the writing surface (3) to 
enable electronic recording of information which is being 
written on the writing surface, by means of a device 
which detects the position code, characterised 
10 in that the product also has at least one activation icon 
(7a-g) which, when detected by the device, causes the 
device to initiate a predetermined operation which uti- 
lises the information recorded by the device. 

2. A product as claimed in claim 1, wherein said 

15 at least one activation icon (7a-g) is provided with the 
position code (5) . 

3. A product as claimed in claim 2, wherein the 

. position code (5) extends continuously over the writing 
surface (3) and said at least one activation icon (7a-g) 
20 in such manner that the activation icon is detectable by 
means of the position code (5) as a predetermined posi- 
tion on the product. 

4. A product as claimed in claim 2, wherein the 
position code (5) on the writing surface (3) is discon- 

25 tinuous with the position code on said at least one acti- 
vation icon (7a-g) . 

5 . A product as claimed in claim 4 , wherein the 
position code (5) with which said at least one activa- 
tion icon (7a-g) is provided constitutes a first subset 

3 0 of an absolute position code, which codes coordinates for 
points on an imaginary surface, the first subset coding 
coordinates for at least one point on the imaginary sur- 
face, which point is dedicated to initiation of said ope- 
ration. 

35 6. A product as claimed in claim 4, wherein the 

position code (5) with which said writing surface (3) 
is provided constitutes a second subset of an absolute 
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position code coding coordinates for points on an ima- 
ginary surface, the second subset coding coordinates 
within an area on the imaginary surface, said area being 
dedicated to electronic recording of information. 
5 7. A product as claimed. in any one of the preceding 

claims, which product comprises a character recognition 
area (A) which is provided with the position code (5) . 

8. A product as claimed in claim 7, wherein the 
position code with which said character recognition area 

10 is provided constitutes a third subset of an absolute 

position code coding coordinates for points on an imagi- 
nary surface, and wherein the third subset codes coordi- 
nates within an area on the imaginary surface, said area 
being dedicate^ to information the characters of which 

15 are to be recognised. 

9. A product as claimed in claim 1, wherein said 
at least one activation icon consists of a plurality 
of activation icons (7a-g) for activating various pre- 
determined operations. 

20 10. A product as claimed in claim 1, wherein said 

at least one activation icon (7a-g) and the position code 
(5) are optically detectable. 

11. A product as claimed in claim 1, wherein said 

at least one activation icon (7a-g) and the position code 
25 (5) are detectable by means of one and the same sensor. 

12 . A product as claimed in any one of the preced- 
ing claims, wherein the predetermined operation is an 
operation from the following group: dialling a telephone 
number included in the recorded information, sending a 

30 fax containing the recorded information, sending an elec- 
tronic message containing the recorded information, writ- 
ing address information included in the recorded informa- 
tion in an electronic address book, entering calendar 
information included in the recorded information in an 

35 electronic calendar, entering a task included in the 
recorded information in an electronic list, printing 
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the recorded information on a printer, and storing the 
recorded information at a predetermined location. 

13 . A product as claimed in any one of the preced- 
ing claims, wherein the position code comprises a plura- 

5 lity of symbols and wherein each symbol contributes to 
the coding of more than one position. 

14 . A product as claimed in any one of the preced- 
ing claims, wherein the position code (5) comprises a 
raster and a plurality of symbols, the value of each sym- 

10 bol being determined by the position of a marking (6) in 
relation to said raster. 

15. A product as claimed in any one of the preceding 
claims, said product being a notepad with a plurality of 
writing surfaces (3) . 

15 16. A product as claimed in claim 15, wherein the 

position code (5) on the various writing surfaces (3) 
codes different positions. 

17. A product as claimed in any one of claims 1-14, 
which product is a paper product consisting of at least 

20 one sheet (80) comprising said writing surface, at least 
part of a surface of the sheet being coated with a pre- 
ferably weakly adhesive layer (81) . 

18. A product as claimed in claim 17, wherein the 
writing surface and the adhesive layer are located on 

25 opposite sides of the sheet. 

19. A product as claimed in claim 17 or 18, wherein 
the product comprises a plurality of essentially identi- 
cal sheets. 

20. A device for information management, which 

30 device is adapted to ^electronically record information 
that is being written on a writing surface (33) , 
characterised in that the device is also 
adapted to initiate a predetermined operation, which uti- 
lises the electronically recorded information when it 

35 detects a predetermined activation icon (7a-g) . 

21. A device as claimed in claim 20, wherein the 
device is adapted to record information electronically 
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by recording a position code (5) which is located on the 
writing surface (3) . 

22. A device as claimed in claim 20 or 21, where- 
in the device is adapted to detect the activation icon 

5 (7a-g) by means of position code (5) with which the 
activation icon is provided. 

23. A device as claimed in claim 20, which device 
comprises at least one sensor (14) for the electronic 
recording of the information that is being written on the 

10 writing surface (3) and of the activation icon (7a-g) . 

24. A device as claimed in claim 23, wherein the 
device comprises a single sensor (14) for the recording 
of the information and the activation icon, which sensor 
is adapted to provide the recording by recording a posi- 

15 tion code (5) with which the writing surface and the 
activation icon are provided. 

25. A device as claimed in claim 23 or 24, which 
device further comprises a signal processor (16) which 
is adapted to detect, in a signal from said at least one 

20 sensor, the activation icon and the recorded information 
for initiation of the predetermined operation. 

26. A device as claimed in claim 24, which device 
further comprises a signal processor (16) which is adapt- 
ed to receive the position code recorded by the sensor, 

25 to determine which position the recorded position code 
codes, to determine, on the basis thereof, whether the 
position code relates to the writing surface, in which 
case the position is processed as representing informa- 
tion that has been written on the writing surface, or to 

30 the activation icon, in which case the predetermined ope- 
ration corresponding to the position is initiated. 

27. A device as claimed in claim 24 or 25, wherein 
the signal processor comprises a character recognition 
function which is adapted to convert the recorded infor- 

35 mation to character-coded format. 
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28. A device as claimed in any one of claims 20-27, 
wherein the device comprises a memory for storing the 
recorded information. 

29. A device as claimed in any one of claims 20-28, 
5 wherein the. device is adapted to utilise, .in the initia- 
tion of the predetermined operation, that part of the 
information which has been recorded from the writing sur- 
face during a predetermined period. 

30. A device as claimed in any one of claims 20-29, 
10 wherein the device is adapted to utilise, in the initia- 
tion of the predetermined operation, information that has 
been recorded in a predetermined area on the writing sur- 
face . 

31. A device as claimed in any one of claims 20-30, 
15 wherein the device comprises a transceiver (20) for wire- 
less short -ran£je communication. 

32. A device as claimed in claim 25 or 26, wherein 
said at least, one sensor (14) is arranged in a first cas- 
ing and the signal processor (16) in a second casing. 

20 33. A device as claimed in any one of claims 20-31, 

further comprising a mobile telephone transceiver for 
transferring the recorded information from the device, to 
an external unit, the predetermined operation being an 
operation from the following group: dialling a telephone 

2 5 number included in the recorded information, sending a 

fax containing the recorded information, sending an elec- 
tronic message with text with the recorded information, 
and printing the recorded information by means of a prin- 
ter, and transferring the recorded information to a draw- 

3 0 ing program. 

34. A device as claimed in any one of claims 19-33, 
wherein the device comprises at least one computer pro- 
gram of the type address book program or calendar program 
or to-do- list program, the predetermined operation con- 
35 sisting of entering a piece of information contained in 
the recorded information in a register for use in one of 
said computer programs. 
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35. A device as claimed in any one of claims 20-34, 
which device is handheld. 

36. A device as claimed in any one of claims 20-35, 
further comprising a pen point (18) for writing the 

5 information on the writing surface (3). while being, 
recorded electronically. 

37. A device as claimed in any one of claims 20-36, 
further comprising means for providing a feedback signal 
to the user when the device detects said at least one 

10 activation icon. 

38. A device as claimed in any one of claims 20-37, 
further comprising means for indicating when the device 
detects the position code. 

39. A computer program for information management, 
15 which is stored on a computer- readable storage medium 

which comprises instructions for causing the computer 
to detect an activation icon and initiate, in response 
to the detection of the activation icon, a predetermined 
operation which utilises electronically recorded, hand- 
20 written information. 

40. A computer program as claimed in claim 39, which 
computer program is adapted to receive, as an input sig- 
nal, a plurality of position indications which represent 
the activation icon and the electronically represented 

25 handwritten information and which comprises instructions 
for analysing the received position indications, the ana- 
lysis comprising processing a received position indica- 
tion as representing part of the handwritten information 
if the position indication belongs to a first subset of 

3 0 positions, and processing a received position indication 
as a command that a predetermined operation is to be exe- 
cuted, if the position indication belongs to a second 
subset of positions. 

41. A computer program as claimed in claim 38, 

35 wherein said analysis comprises detection of a position- 
coding pattern in images which are received as an input 
signal to the program and conversion of the position- 
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coding pattern to position indications in the form of 
coordinates . 

42. A computer program as claimed in claim 39, fur- 
ther comprising instructions for the following steps: 



tion-coded sheet, 

- detection (99) of a graphical input on said sheet, 
and further 

- reproduction (100) of said graphical input in a 
10 program window associated with an application in a com- 
puter system, which application is associated with said 
activation icon. 

43. A system for information management, comprising 
a device which is adapted to record information electro- 

15 nically and a product which is provided with at least one 
activation icon indicating a predetermined operation, the 
device being adapted to initiate the predetermined ope- 
ration for the recorded information in response to the 
detection of said at least .one activation icon on the 

20 product. 

44. A system as claimed in claim 43, further com- 
prising a writing surface, which is provided with a posi- 
tion code coding a plurality of positions on the writing 
surface, the device being adapted to record the informa- 

25 tion electronically. 

45. A method of recording and processing informa- 
tion, comprising the steps of writing information on a 
writing surface using a device; recording the written 
information electronically using the device, char- 

30 a'cterised by the step of causing the device to 
carry out a predetermined operation for the recorded 
information by letting the device detect an activation 
icon before or after the recording of the written infor- 
mation. 

35 46. A handheld electronic device which is adapted 

to carry out predetermined operations at the command of 
a user, characterised by a sensor for detect- 



5 



detection (98) of the activation icon on a posi- 
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ing at least one activation icon, and a signal proces- 
sor which is adapted to carry out, in response to the 
sensor's detection of the activation icon, one of said 
predetermined operations. 




Fig. 1 




Fig. 7 



WO 01/16691 



PCT/SE00/01667 




PCT/SEOO/01667 




98 



99 



100 



Fig. 9b 



Detect 

Activation Icon 



Detect Graphical 
Input 



Reproduce 
Graphical Input 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/SE 00/01667 



A. CLASSIFICATION OF SUBJECT MA ITF.R 



IPC7: G06F 3/033, G06K 11/06, G06K 1/12 

According to International Patent Classification (IPC) or to both national classification and IPC 



D. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC7: G06F, G06K 



Documentation searched oilier than minimum documentation to lite extent tiial such documents arc included in Ore fields searched 

SE,DK,FI,N0 classes as above 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



C. DOCUMENTS CONSIDERED TO HE RELEVANT 



Category* 



Gtation of document, with indication, where appropriate, of the relevant passages 



Relevant lo claim No. 



GB 2306669 A (RICOH COMPANY LTD), 7 May 1997 

(07.05.97), page 2, line 4 - line 11; page 3, 
line 1 - page 4, line 3; page 6, line 1 - page 8, 
line 5, page 8, line 17 - line 20; see figure 1; 
abstract 



US 5194852 A (E. MORE ET AL), 16 March 1993 

(16.03.93), column 6, line 41 - column 10, line 28, 
figure 1, claim 1 



US 5652412 A (M. LAZZOUNI ET AL), 29 July 1997 

(29.07.97), column 2, line 38 - column 3, line 34; 
column 14, line 16 - line 33, figures 3,4,7, 
claims 1,21 



1-2,4-12, 
15-36,39-46 



1-9,11-12, 
20-46 



1-12,15-46 



x| Further documents are listed in the continuation of Boa C. | )(| See patent family annex. 



Special categories of died documents: 

"A* document defining the general suie or the art which is not ctmsidcrcd 
to he of particular relevance 
II* earlier application or patent hut published on or after the international 
filing date 

L" document which may throw douhls on priority claim(s) or which is 
cited lo establish the publication date of another citation or other 
special reason (at specified) 

"O* document referring to an oral disclosure, use, exhibition or other 
means 

V document published prior to the international filing date hut later than 
the priority dale claimed 



*T* lalcr document published after the international filing date or pruirity 
date and not in conflict with the Application but cited lo understand 
the principle or theory underlying the invention 

"X" document of pArticuJar relevance: the claimed invention cannot be 
considered novel or cannol he considered lo involve an inventive 
step when the document is taken alone 

"Y" document of particular relevance: the claimed invention cannol he 
considered in involve an inventive step when the document is 
comhincd with one or more other such documents, such combination 
being obvious tu a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 



4 December 2000 



Name and mailing address of the ISA/ 
Swedish Patent Office 
Box 5055, S-102 42 STOCKHOLM 
Facsimile No. + 46 8 660 1)2 X6 



Hate of mailing of the international search report 

0 6 -12- 20M 



Authorized olliccr 



Par Heimdal/LR 

Telephone N». +46 8 7K2 25 00 



Form PCT/ISA/210 (second sheet) (July 1998) 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/SE 00/01667 



C (Continuation). DOCUMENTS CONSIDERED TO 111* RELEVANT 



Category 



GlaUoti of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5932863 A (S. RATHUS ET AL), 3 August 1999 

(03.08.99), column 3, line 17 - line 29; column 7, 
line 36 - line 51, claim 1 



US 5477012 A (0. SEKENDUR), 19 December 1995 

(19.12.95), column 2, line 11 - column 3, line 41, 
figures 1-6, abstract 



JP 10187907 A (OLYMPUS OPTICAL CO LTD) 1998-07-21 
(abstract), [online] [retrieved on 2000-12-06], 
Retrieved from: EPO PA J Database; 



1-12,15-46 



1-46 



1-46 



Form PCT/ISA/210 (continuation of second sheet) (July 1998) 



INTERNATIONAL SEARCH REPORT 

Information cm patent, family members 



02/11/00 



International application No. 

PCT/SE 00/01667 



Patent documcnl 


Publication 




Patent family 


Publication 


cited in search report 


date 




mcmbcr(s) 


dale 


GB 2306669 A 


07/05/97 


DE 


19644109 A 


07/05/97 






GB 


9622632 D 


00/00/00 






JP 


9128137 A 


16/05/97 






US 


6081261 A 


27/06/00 



US 5194852 A 16/03/93 EP 0416176 A,B 13/03/91 

US 4839634 A 13/06/89 



US 5652412 A 29/07/97 NONE 

US 5932863 A 03/08/99 NONE 



US 


5477012 A 


19/12/95 


AU 


4529896 A 


14/07/97 








EP 


0892971 A 


27/01/99 








WO 


9722959 A 


26/06/97 








US 


5852434 A 


22/12/98 



Form PCT/ISA/210 (patent family annex) (July 1998) 



